Goto

Collaborating Authors

 human pose regression


Chirality Nets for Human Pose Regression

Neural Information Processing Systems

We propose Chirality Nets, a family of deep nets that is equivariant to the "chirality transform," i.e., the transformation to create a chiral pair. Through parameter sharing, odd and even symmetry, we propose and prove variants of standard building blocks of deep nets that satisfy the equivariance property, including fully connected layers, convolutional layers, batch-normalization, and LSTM/GRU cells. The proposed layers lead to a more data efficient representation and a reduction in computation by exploiting symmetry. We evaluate chirality nets on the task of human pose regression, which naturally exploits the left/right mirroring of the human body. We study three pose regression tasks: 3D pose estimation from video, 2D pose forecasting, and skeleton based activity recognition. Our approach achieves/matches state-of-the-art results, with more significant gains on small datasets and limited-data settings.


Reviews: Chirality Nets for Human Pose Regression

Neural Information Processing Systems

A growing body of literature has shown that building symmetries into neural networks through equivariant layers is an effective means of improving results, especially in the face of limited data and even when data augmentation is used. This paper continues that trend by showing that equivariance to chirality transformations consistently improves results on pose regression tasks. The paper is well written and easy to follow. Related work is discussed in a mostly adequate and balanced manner. The work fits in existing theoretical frameworks when considering that the group acts in a linear way (though not via permutations).


Chirality Nets for Human Pose Regression

Neural Information Processing Systems

We propose Chirality Nets, a family of deep nets that is equivariant to the "chirality transform," i.e., the transformation to create a chiral pair. Through parameter sharing, odd and even symmetry, we propose and prove variants of standard building blocks of deep nets that satisfy the equivariance property, including fully connected layers, convolutional layers, batch-normalization, and LSTM/GRU cells. The proposed layers lead to a more data efficient representation and a reduction in computation by exploiting symmetry. We evaluate chirality nets on the task of human pose regression, which naturally exploits the left/right mirroring of the human body. We study three pose regression tasks: 3D pose estimation from video, 2D pose forecasting, and skeleton based activity recognition.


Chirality Nets for Human Pose Regression

Yeh, Raymond, Hu, Yuan-Ting, Schwing, Alexander

Neural Information Processing Systems

We propose Chirality Nets, a family of deep nets that is equivariant to the "chirality transform," i.e., the transformation to create a chiral pair. Through parameter sharing, odd and even symmetry, we propose and prove variants of standard building blocks of deep nets that satisfy the equivariance property, including fully connected layers, convolutional layers, batch-normalization, and LSTM/GRU cells. The proposed layers lead to a more data efficient representation and a reduction in computation by exploiting symmetry. We evaluate chirality nets on the task of human pose regression, which naturally exploits the left/right mirroring of the human body. We study three pose regression tasks: 3D pose estimation from video, 2D pose forecasting, and skeleton based activity recognition.